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PREPARING THE NAMED ENTITY GRAMMARS, IF ANY, USED BY _ « 
THE NLU MODEL BUILDING PROCESS. 



I 



CREATING A LIST OF SAMPLES UTTERANCES FROM THE L ABELING GUIDE. \^ 1 



CREATING A SMALL NUMBER OF HAND CRAFTED RULES FOR EACH _ 1 



CALL-TYPE DEFINED IN THE LABELING GUIDE. 



GENERATING A FIRST NLU MODEL USING THE SMALL NUMBER OF 1 
HAND CRAFTED RULES. 



I 



TEST THE FIRST NLU MODEL USING THE LIST OF SAMPLE UTTERANCES 
AN D FIXING ANY DISCREPANCIES, IF APPROPR IATE. 

I 



ENTERING A SMALL NUMBER OF OBVIOUS UTTERANCES FOR THE 
APPLICATION AND CHECKING WHETHER THE OBVIOUS UTTERANCES WERE 
CORRECTLY CLASSIFIED WITH A HIGH ENOUGH CONFIDENCE. 

\ 

BUILDING A SECOND NLU MODEL USING THE SAMPLE UTTERANCES 
FROM THE LABELING GUIDE AS NEW TRAINING DATA AND THE HAND 
CRAFTED RULES. TESTING THE PERFORMANCE OF THE SECOND NLU 
MODEL USING A FIRST BATCH OF LABELED DATA. 

I 



USING MORE BATCHES OF LABELING DATA, BUILDING A SERIES OF 
NLU MODELS BY ADDING THE PREVIOUS BATCH'S DATA TO TRAINING 
DATA AND USING THE NEW BATCH AS TEST DATA TO GENERATE A 
SERIES OF NLU MODELS WHOSE TRAINING DATA INCREASES CONSTANTLY 
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PERFORMANCE IMPROVEMENT PHASE — 130 



ADDING THE TEST DATA TO THE TRAINING DATA AND BUILDING A 

NEW NLU MODEL 



— 132 

— 134 



AUGMENTING THE NEW NLU MODEL BY USING UTTERANCES 
OBTAINED FROM THE CUSTOMER ACCEPTANCE TEST (CAT) 




